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Abstract 

In this paper, we examine higher order difference problems: 

oo 

maxJ2U{c(t),c(t + 1),- ■ ■ ,c(t + N-l),t). Using the "squeezing" 
c t=o 

argument, we derive both Euler's condition and the transversality con- 
dition. In order to derive the two conditions, two needed assumptions 
are identified. A counterexample, in which the transversality condition 
is not satisfied without the two assumptions, is also presented. 
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1. Introduction 
In this paper, we consider the following reduced form model 

' oo 

maxV[/ (c(i), c(t + 1), • • • , c(t + N - 1), t) 

c ' J 

(1) \ 4=0 

subject to c(0) = c , 
k Vt > 0, (c(t), c(t + 1), • • ■ , c(t + N - 1)) e X(t) C (E n ) JV , 

where A" G N, Z7 is a real-valued iVth-order continuously differentiable 
function, and c = (ci,c 2 ,--- , c n ) is A^th-order continuously differ- 
entiable. Q Notice that the objective functional of ([1]) can be infi- 
nite. j7] considers the continuous time first order differential problems: 
v (x (t) , x (t) ,t). It generalizes the results of [5j [101 [12]. So far, the 
most general form of the transversality conditions for continuous time 
version of problem ([1]) is presented in [11], which extends the first or- 
der case considered in |7] (Theorem 3.2) to higher order cases. [7] was 
later extended to the discrete time stochastic case by [S]. In this paper, 
we aim to extend these results to deterministic higher order difference 
problems, using the "squeezing" argument. 

The application of higher order difference problems can be widely 
found in economics. In particular, they appear in the discussion con- 
cerning the overlapping generations models. A satisfactory examina- 
tion of the individuals' marriage and fertility decisions would necessi- 
tate the division of the representative agent's lifetime to multiple peri- 
ods, instead of only two periods, young and old. However, as argued in 
[I], the properties of a model with two-period-lived agents cannot be 
readily extended to n-period-lived agents. To consider the n-period- 
lived agents case, transversality conditions for higher order difference 
problems would be imperative. 

We first use the "squeezing" argument to derive both Euler's condi- 
tion and the transversality condition for higher order difference prob- 
lems, showing the argument needs two imperative assumptions. These 
two assumptions constitute the discrete time version of Assumption 1 
and 2 in [TT] . We then provide a counterexample, in which the transver- 
sality condition is not satisfied without the two assumptions. Because 
Assumption 1 and 2 are satisfied when a discounting factor is incor- 
porated into the model, our transversality conditions also generalize 
the results obtained in the presence of discounting. For approaches on 



1 Normally, U is defined on (R n ) N x K. The domain of U is denoted by X (t), 
in included in (M n ) , for all t. 



how to explicitly construct the optimal solutions to the undiscounted 
infinite horizon optimization problems, see [2JI3]. 

2. Derivation of the Transversality Conditions 

Suppose that the optimal path to (JTJ) exists and is given by c* (t), 
optimal in the sense of an overtaking criterion to be defined below. We 
perturb it with iVth-order continuously differentiable curves q(£), 

(2) c(t) = c*(*)+e.q(t). 
We define 

T' 

V(e, T) = mf / £>(c'(t) + e ■ q(f), c*(t + 1) + e ■ q(t + 1), 

- t=o 

■ ■ ■ , c*(t + N — 1) + e ■ q(i + N — l),t) 

(3) - U (c* (t) , c* (t + 1) , • • - , c* (t + N - 1) , t)] . 

In this paper, [1] 's notion of weak maximality is used as our optimality 
criterion. We assume that there exists an optimal path that satisfy 
the weak maximality criterion, which is defined as: an attainable path 
(c* (£)) is optimal if no other attainable path overtakes ii@: 

r 

lim inf V[C/(c*(i) + e ■ q(t), c*(t+l)+e- q(t + 1), 

~ t=0 

■ ■ ■ , c*(t + N - 1) + e ■ q(t + N - 1), t) 

(4) - U (c*(t),c*(t + 1), • • • , c*(t + N - l),t)} < 0. 
Let Vie) = lim V (e,T). Differentiating it with respect to e, we 

T— >-oo 

have 

lim V{S > 



e-s>+0 e 

T 



= lim lim inf V -\U(c*(t) + e ■ qit), c*(t + 1) + e ■ q(t + 1), 

■■■ ,c*(t + N - 1) + e ■ q(t + N - l),t) 
(5) -U (c*(t),c*(t + 1), • • • , c*(t + N-l),t)\. 

Let lim ^ £ = fi. Generally, — lim f(e,T) = lim — f(e,T) only 

when lim —f(e,T) converges uniformly for e (El). We assume 

t->oo de 



PQ shows that such a path exists once two assumptions are satisfied. 
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Assumption 1. Assume Q converges uniformly for e when T — > oo 
Assume Assumption 1, we can then restate (jSJ) as 

Q = lim lim inf - 

T— »oo e— >-+0 T<T' 6 



T' 

X 

t=0 

(6) -U{c*(t),--- ,c*(t + N-l),t)]. 



Y^[U (c*(t) + £ • q(t), ■ • • , c*(t + A - 1) + e ■ q(t + A - 1),*) 



We also assume 

Assumption 2. We assume for any T > 0, 



inf / ^ -[£/ (c*(t) + £ • q(t), ■ • • , c*{t + TV - 1) + e ■ q(t + A - 1), t) 
-C7(c*(t),--- ,c*(t + A-l),t)] 



T<T' ^— ' £ 
~ t=0 



converges uniformly for e. 

As in [11], a precise interpretation of Assumption 2 can be given as 
follows: Let 



1 

a(t, e) = -l u ( C *W + £ ■ q(*)> • ■ ■ > c *(* + ^ - !) + £ • q(* + ^ - !)»*) 



-f/(c*(t),--- ,c*(t + A-l),t)]. 



Then there exists a sequence A (T£, e) for each e > 0, so that lim A (T' n , e) 

n—toc 

inf A (T", e) , uniformly for e, that is, the sequence is uniformly con- 
vergence for e. 

Assumptions 1 and 2 extend Assumption 3.1 in [7|. When Assump- 
tions 1 and 2 are satisfied, then lim and inf can be interchanged, 

and equality ([6]) can then restated as 
Q = lim inf lim - 

T^ooT<T' e->+0 8 
T> 

x ( C *W + e ■ Q(*) s • • • > c *(* + A - 1) + £ • q(t + A - 1),*) 

i=0 

(7) _y(c*(t) s ... ,c*(* + A-l),*)]. 



Because T' is finite uniformly for e, if 
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J2~[U (c*(t) + e ■ q(t), ■ ■ ■ , c*(t + iV - 1) + e ■ q(t + JV - 1), i) 

t=o e 

-C/(c*(t),--- ,c*(* + JV-l)),t] 

exists, ([7]) is then rewritten as 
r 1 

= lim inf > - 

T->oo T<T' ^— ' £ 
~ t=0 

x [£/ (c*(t) + £ • q(t), • • • , c*(t + JV - 1) + e • q(t + JV - 1), t) 
(8) -U(c*(t),--- ,c*(t + N-l),t)}. 

From the differentiability of U, we have 



lim -\U (c*(t) + e ■ q(t), ■ • • , c*(t + JV - 1) + e • q(t + JV - 1), t) 

-C/(c*(*),--- ,c*(f + JV-l),t)] 
^ dU (c*(t), c*(t + !),••• , c*(t + JV — 1), t) 



dci(t) 

. . r*(i ilV-1l ^ 



i=l 

dU (c*(t), c*(t + !),•••, c*(t + JV - 1), i) 



d Ci (t + l) 

0Ef(c'(t),c'(t + !),•■■ ,c*(t + N-l),t) 

+ "' + + 1) qA + jJ - 



Hence, 



' ' " ,dU (c*(t), c*(t + !),•■■, c*{t + JV - 1), i) 



- t=0 i=l n 7 



dt/(c*(t),c*(t + !),■■• ,c*(f + JV-l),t) 

+ a^TI) + + - 

0Ef(c*(t),c*(t + !),••• ,c*(t + JV-l),t) ^ A7 
+ ac .( £ + iV _i) ^ t + iV ^ 
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We derive 



/ " fdUit) , s dU(t) , Ar 1X N 



EE 

t=o \i=l \ 



d Ci (ty lK ' da(t + N-i) 



+ sjm± _^ qi(N _ 2) 

f g(^(t-N + i) + --- + ^(t)) ^ m 

t=JV-l v 7 

/ a(^(r-iv + 2) + --- + [/(r)) Y 

+ v ^+1) 

< 9 > + dcd Tl T N-l) ^ T ' + N -^ 



Hence, Euler's condition is 
dU(0) 



dci(0) 

d (U(0) + [/(!)) 



0, 

YlYl 

= 0, 



<9q(l) 

J 

a(C7(0) + --- + t/(iV-2)) 
9ci(t) 



(10) d W t - N + 1 ] + - + m) =0,forN-Kt<T> 

which extends the standard Euler's condition, and the transversality 
condition is given by 



° g{u( r- N + 2) + . +u(r)) 

T— >-oo T<T' ' dCi(T' + l) V ' 

i=l 

(in +...+ d ( u ( T ')) Qi (r + N -i)\<o. 

K ' dci (T' + N — 1) ;J - 



Note that when e — > 0, the argument is the same: 

hm sup > — — r Oj (T +1 

T^ T< f^ [ dci(T' + l) HlK J 

d(U(T')) 

(in + -- + 9c , ( r- + /i) ^ r+Af - 1 )i ao ' 

Next, we consider the linkage between our result and that in [TJ. We 
fix < a < 1 and a : M+ ->• R+ o(0) =0, ■ • • , c^-^O) = 0, 

a(t) = a, t > 1. We let £ ->■ + 0. Let q(t) = ac*(t), then (HD) is 
modified to 

Inn ^^(^^-^2) + ...^^) 
r->oo t<t'^ l <9c;(T' + l) lV ; 

i=l 



d(U(T')) * (T ,^ N U] 
+ --- + dc t (T' + N-lf C ^ T+N - 1)] 

=a hm mf > — — , ' r — —c* (T + 1) 

T^ooT<T'^ 1 dd(T' + l) lK ' 

i=l 



dd (T' + N-l 
(12) <0. 

Because a > 0, we then have 



T^ooT<T'^ [ dd(T' + l) * V ' 

i=l v ' 

d(U(T')) 

(13) + ... + s _^JJL j(?( 7' + JV - 1)] < 0. 

which is an extension of [Tj's transversality condition. 



3. A Counterexample 

We proceed to show that Assumption 1 and 2 are imperative in the 
sense that (llip becomes invalid if one of them is violated. We consider 
the following simple counterexample: 



(14) U (c(t),c(t + 1), c{t + 2),t) = (c(t) - a) 2 + (3c{t + 1) + 7 c(£ + 2), 



s 



where a>0,/3>0,7>0, and the initial values c(0) = Co, c(l) = ci 
are given. From ffTUl) . we see that Euler's condition is given by 



dU(0) 



0. 



(15) 



dc(0) 

d(t/(o) + i/(i)) 

dc(l) 
d(U(t-2) + U(t 
ddt) 



0. 



1) + U(t)) 



0,2 < t < T', 



which implies 



(15') t=0, 

(15") t=l, 

(15"') t = 2, 

(15"") t = 3, 



(15 ) t = T', 



2(c(0) - a) = 0, 
2 (c(l) - a) + /3 = 0, 
2 (c(2) - a) + /3 + 7 = 0, 
2 (c(3) - a) + /3 + 7 = 0, 

2 (c (T") - a) + + 7 = 0. 



Thus, we have c(2) = c(3) = • • • = c (T') = a — - ^ — . 

Choosing a p so that p(0) = and p(i) > 0, there exists T > 0, p{t) 
is a constant > when t >T . 
From (fUj) . we see that 



(16) 
(17) 



d (U (V 



U (TO) 



5c(t + 1 
0(17 (TO) 



(Z (r / + l) = ( 7 + /3)g(T' + l)<0, 



dc(t + 2) 



g (T' + 2) = 1Q (T + 2) < 0. 



Hence, we have arrived at a contradiction to ( |TTi) . 

Next, we show that Assumption 1 is violated, which causes this con- 
tradiction. We consider U (c*(t) + ep(t), c*(* + 1) + ep(t + 1), c*(t + 2) + ep(t + 2)) 

/? + 7 

-17 (c*(t), c*(t + 1), c*(t + 2)). Substituting c*(t) = a - -y- into it, 



we have 

U (c*(t) + ep(t),c*(t + 1) + ep(t + 1), c*{t + 2) + ep(t + 2)) 

- U(c*(t),c*(t + l),c*(t + 2)) 

= (c*(t) + ep{t) -af + P (c*(t + 1) + ep{t + 1)) + 7 (c*(t + 2) + ep(t + 2)) 

- ((c*(t) - a) 2 + /3c*(* + 1) + 7 c*(t + 2)) 

(18) 

^W-l^y 2 )) +e(#>(f + l)+7P(* + 2)) ^ + 7 ' 
Hence, 

r' f ep(*) - (^yl) ) 2 + + 1) + £ 7 P(^ + 2) ^ + 7 " 

T<T' £ 

~ t=o 

T' 

■j, T . 



T<T 

(19) 



itf £ (ep(t) 2 - (/? + 7 )p(0 + £p(* + 1) + 7P(< + 2)) 

sY,pitf + ^p{T' + l)+ 1 p{T , + 2) 
t=o 



--£ {P^) 2 ) + PPoo + IPo 



i=0 

f2 is the limit of ffTB]) when T — >■ oo, e — > 0. However, 

T 



because lim lim j (p(^) 2 ) + /^Poo + 7Poo J = oo, 

whereas ^lirr^lim ^ (p(t) 2 ) + fip^ + 7P00J = fipoo + IPoo, we see 

that Q does not converge uniformly for e when T — > oo. Hence, As- 
sumption 1 is violated and (ITTj) is also not satisfied. 

4. Conclusion 

This paper gives the two assumptions that would be imperative when 
examining infinite horizon discrete time optimization problems in which 
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the objective functions are unbounded. Our results generalizes the re- 
sults of [SI El QUI [12] (N = 1) to higher order difference problems. 
Specifically, when N = 1, our transversality condition is the discrete 
time version of that of [7] (Theorem 3.2). Moreover, our Assumption 1 
and 2 also constitute the discrete time version of the Assumptions in 
[TT] . As in [TT] . our Assumption 1 and 2 obviously hold when a dis- 
counting factor is incorporated into the model. In this sense, this paper 
also extends the transversality conditions examined in the presence of 
discounting. 
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